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ABSTRACT 

Feedback heating from AGN in massive galaxies and galaxy clusters can be thought 
of as a naturally occurring control system which plays a significant role in regulating 
both star formation rates and the X-ray luminosity of the surrounding hot gas. In the 
simplest case, negative feedback can be viewed as a system response that is 'optimised' 
to minimise deviations from equilibrium, such that the system rapidly evolves towards 
a steady state. However, a general solution of this form appears to be incompatible 
with radio observations which indicate intermittent AGN outbursts. Here, we explore 
an energetically favourable scenario in which feedback is required to both balance 
X-ray gas cooling, and minimise the sum of the energy radiated by the gas and the 
energy injected by the AGN. This specification is equivalent to ensuring that AGN 
heating balances the X-ray gas cooling with minimum black hole growth. It is shown 
that minimum energy heating occurs in discrete events, and not at a continuous, con- 
stant level. Furthermore, systems with stronger feedback experience proportionally 
more powerful heating events, but correspondingly smaller duty cycles. Interpreting 
observations from this perspective would imply that stronger feedback occurs in less 
massive objects - elliptical galaxies, rather than galaxy clusters. One direct conse- 
quence of this effect would be that AGN heating events are sufficiently powerful to 
expel hot gas from the gravitational potential of a galaxy, but not a galaxy cluster, 
which is consistent with theoretical explanations for the steepening of the Lx — T 
relation at temperatures below 1-2 keV. 
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1 INTRODUCTION 

The cooling time of X-ray emitting gas in the cores of 
many massive galaxies and galaxy clusters is much shorter 
than the Hubble time. In the absence of heat sources, the 
gas will cool and form stars. However, high-resolution X- 
ray spectroscopy of galaxies and clusters has shown that 
the rate at which gas cools to low temperatures is signifi- 
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somehow being reheated. 

Numerous possible heating mechanisms have been sug- 
gested, most notab ly energy injection by Active Galactic 
Nucl e i (AGN) (e.g. [Binnev fc Taborlll995l ; iTucker fc Davidl 
1 19971 ; ICiotti fc Ostrikerl^OOlT ) and the inward flux of ther- 
mal energy from large radii due to thermal conduction (e.g. 



is difficult due our incomplete understandi ng of the micro- 
physics of the X-ra y emitting plasma (see lCho et al.l [20031 ; 
IParrish et "all [2009. for example). Nevertheless, due to its 
strong temperature dependence, thermal conduction alone 
probably cannot p rovide a general solut i on to the cooling 
flow problem (e .g. IVoigt fc Fabianl 120041 : IPope et all l200d : 
iGuo et al.ll200a i. 

Instead, it is generally assumed that energy input by a 
central AGN is predominantly responsible for reheating the 
gas. This is partly based on a wealth of observational evi- 
dence which indicates that radio AGN outflows are triggered 
in response to the thermal state of their envir onment (e.g. 
| BurnJl990l;lBest et al.ll2005l;lBirzan et alJl20bH;|Punn et all 
2005l : lBestll2007l:lRaffertv et al.ll200Sl : ICavagnolo et al.ll2o'oa 
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ity is part of a negative feedback loop which may regulate 
properties of its environment. 

Theoretical studies have also provided complimentary 
evidence highlighting the importance of AGN feedback. For 
example, implementations of AGN heating in semi-analytic 
models of galaxy formation have shown that, in principle, 
AGN can both reheat cooling flows and explain the ex- 
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ponential cutoff a t the bright end of the galaxy luminos- 
ity function (e.g. iBenson et at.l 120031; ICroton et at] 120061 ; 
iBower et at] 120061 : IShort fc Thomad 1120091 ). More recently. 
AGN heating has been shown to be fundamental in shaping 
the X-ray luminosity - temperature of massive galax ies (e.g. 
IPuchwein et al.ll2008l : lrBower et al.ll2008l : |Popell2009l ). 

Broadly speaking, theoretical studies employ AGN 
heating as an input with which to control star formation 
rates and the X-ray luminosity of the hot gas that perme- 
ates massive galaxies and galaxy clusters. Essentially, this 
conceptualises AGN feedback as a control system similar 
to a thermostat (c.f. iKaiserl feoOT), This approach can be 
highly informative; AGN feedback is an extremely complex 
phenomenon which depends on poorly understood physical 
processes occurring across a huge range of spatial scales. 
As yet, numerical hydrodynamic simulations do not include 
sufficient physical processes to naturally reproduce observa- 
tions without being complemented by additional numerical 
prescriptions. Yet, even if the simulations were physically 
complete, the outcomes would still need to be interpreted. 

For this reason, we investigate AGN feedback in the 
most general way, by expressing its overall effect in terms of 
well-defined global quantities, and comparing the main re- 
sults with observations. For example, consider the simplest 
case, in which AGN heating is regulated only by negative 
feedback. Negative feedback can be defined as a response 
which occurs to oppose its cause. Therefore, unless forced 
to do otherwise, it will tend to minimise deviations from 
some equilibrium condition. Thus, in general, a system reg- 
ulated purely by negative feedback will rapidly tend towards 
a steady state in which the controller is permanently active 
at a constant value. Notably, this does not appear to be the 
case for AGN feedback, and it is imperative to note that 
minimising deviations from an equilibrium state is only one 
measure of the performance of feedback. Depending on addi- 
tional constraints it can also be favourable to minimise other 
quantities, such as the energy invested in controlling the sys- 
tem. Importantly, a system regulated by feedback subject to 
additional constraints generally behaves quite differently to 
the simplest case described above. 

The choice of constraint adopted in this article is in- 
fluenced by two principle sets of observations. In particular , 
radio data (e.g. iBest et al.|[2005l . 120071 ; IShabala et aT] [20081 
can be used to infer the fraction of time (duty cycle) an AGN 
spends producing kinetic outflows, which couple strongly to 
the ambient gas. Therefore, a feedback model which yields 
continual and constant heating would appear to be incon- 
sistent with data. In addition, any appropriate model must 
also grow black ho l es of t he masses we observe. For example, 
iFuiita fc Reiprichl l|2004h found that, in some cases, the ac- 
cretion energy liberated in growing the supermassive black 
holes at cluster centres seems to be insufficient to have offset 
the ICM X-ray luminosity over the lifetimes of the clusters. 
That is, the some black hole masses are lower than expected. 
As a result, the aim of this article is to find a plausible con- 
straint which forces a simple feedback system to exhibit fea- 
tures that are broadly similar to these observations; heating 
should proceed in the form of discrete events and at low 
black hole growth rates, while still balancing gas cooling. 

Guided by these observations, we investigate an ener- 
getically favourable model in which feedback heating acts to 
balance gas cooling, but is also constrained to minimise the 



total energy output of the system. This means that feed- 
back minimises the sum of the energy radiated by the X-ray 
emitting gas and the energy injected by the AGN, which 
is equivalent to balancing gas cooling with the minimum 
black hole growth. Such constraints are implemented, with 
the minimum number of assumptions, by employing optimal 
control theory 0. Using this approach, we also show that the 
constraint prevents continuous, constant AGN power out- 
put, but favours discrete AGN outbursts with a duty cycle 
which depends only on the feedback strength. Therefore, de- 
spite being largely empirical, the constraint warrants investi- 
gation as a baseline model against which both observations 
and numerical simulations can be compared. However, we 
note that there may be other equally plausible interpreta- 
tions, and explanations, of these observations. 

The outline of the article is as follows. Section 2 out- 
lines a simple feedback model. In Section 3, we investigate 
the effect of the mimumum energy constraint which is im- 
plemented using optimal control theory. The findings are 
discussed in section 4 and summarised in section 5. 



2 A SIMPLE MODEL 

Current interpretation of observations suggests that radio 
AGN heating is relate d to the cooling rate of the hot, X- 
ray emitting gas f e.g. IBest et al. 120051 ; iBirzan et al. 1 12004 



iDunn et al] 120051 ; iNulsen et al 



20071 ) . which itself must 



evolve according to the difference between the AGN heat- 
ing and gas cooling rates. The precise details of the inter- 
action between a collimated AGN outflow and the ambient 
gas may be relevant on kiloparsec scales, but are much less 
so on larger scales, since the injected e nergy is eventuall y 
dissipated more or less isotropically (see lHeinz et al.i r2006). 
Therefore, on large spatial scales, AGN heating can be ap- 
proximated as supplying thermal energy alone (e.g. iPopel 
120091 ; iFabian et al.ll2010f ) and it is reasonable to expect the 
heating/cooling system to be explicable by a relatively sim- 
ple model. In terms of general expectations, radiative cooling 
from the hot gas is a positive feedback process - as energy 
is radiated, the gas loses pressure support, contracts and 
radiates at an accelerating rate. As a result, the iVth time 
derivative, d N Lx/d£ N , must itself be related to Lx(t), in 
some way. Conversely, heating will cause the X-ray emitting 
gas to expand, thereby reducing its luminosity. With this 
in mind, and without making any unnecessary assumptions, 
suppose that H(t) and Lx(i) can be related by a continuous 
time, linear, N-th order differential equation of the form 



d Ix d 
in — 7-5 — h (Jn-i 



di N 



dt N ~ 



+ ■ 



(1) 



d L/X dLx r rr/ \ 

+ a 2 — -5- + ai— — + o Ix = H (t). 
at 2 at 



1 Optimal control theory has a wide range of applications extend- 
ing beyond engineering and finance to complex biological systems 
as well as physics. Astrophysically, optimal control theory is ap- 
plied in adaptive optics, but does not ap pear to have been widely 
adopted in theoretical research, though lHaggag fc Safkol [|2003h 
employed the approach to demonstrate a concise derivation of 
the Tolman-Oppenheimer-VolkofT equation of hydrostatic equi- 
librium. 
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Note that, in its present form, equation Q is a generic de- 
scription for the variation of the X-ray luminosity, Lx(i), 
in response to an externally applied heating rate, H(t). 
However, heating rates derived from observations of X-ray 
cavities inflated by AGN seem to cor relate with the X- 
ray luminosity o f the host cluster (e.g. iBirzan et al. I l2004l ; 
iDunn fc Fabianll2008l), sug gesting H(t) oc L x (t). Further - 



pling constant, fa, will be non-zero; as a result H(t) is only 
related to Lx(t). 

By assuming feedback control, equation (0) reduces to 



Raffertv et all (|2008r ) (see also lCavagnolo et al.ll200S 



showed that AGN in cluster centres seem to be activated 
when the central cooling time of the ICM is below ~ 0.5 Gyr. 
For this reason, we can express the heating rate as H(t) = 
a(t)faL x (i), where fa is a constant of proportionality (the 
feedback strength), and a(t) is a parameter which varies 
between and 1 depending on the central cooling time. 

The physical processes that govern how a(t) varies are 
highly uncertain, as mentioned in the introduction. They re- 
late to how material from the ICM reaches the black hole, 
and how the resulting energy output from the AGN out- 
flow is dissipated in the surrounding medium. Rather than 
trying to solve the gas physics explicitly, we can pose the 
problem in a different way. From obs ervations indicat i ng re- 
current discrete AG N outbursts fe.g. lBest et~ai1l2005l . [20071 ; 
IShabala et al.1120081 ). we conclude that a(t) does vary and is 
probably close to zero for a significant fraction of the time, 
but also close to unity at other times. This suggests that 
AGN heating causes the central cooling time of the ICM 
to significantly overshoot the critical value of w 0.5 Gyr. As 
a result, it is clear that AGN heating influences a(t), and 
a(t) influences AGN heating. The crucial question then is: 
how must a(t) be made to vary in o rder to explain the ob- 
served radio AGN duty cycles (e.g. iBest et alj|2005l . 120071 ; 
IShabala et alj [20081? One possible solution is obtained by 
employing optimal control theory. 

For convenience, equation |T} can be expressed in ma- 
trix form as a system of first order differential equations. 
These descri be the evolutio n of the state variables of the 
system (e.g. iFairmanl ll998T ). which are defined as qi(t), 
92(i)....<?N(i) where qi = i X) q'i{t) = dLx/dt up to q N = 
d N_1 Lx/df N_1 . Therefore, the time derivatives of the state 
variables are <ji = 172, 92 = qs up to <jn = — [on-i^n + 
aN-25N-i + aoqi — H(t)]/a,N- The system can then be writ- 
ten compactly as 

q(t) = Aq(t)+B#(t), 

Lx(t) = Cq(t), (2) 

where q(t) is the column vector containing the state vari- 
ables, q(t) is its time derivative and A is called the system 
matrix. For a system that has m inputs and p outputs, and 
TV state variables, A is an TV x TV matrix, B is an TV x m ma- 
trix and C an p x TV matrix. Therefore, for the case described 
above B is a column vector and C is a row vector. 

The most convenient way to express the feedback equa- 
tion is to assume the control is linearly proportional to all of 
the states of the system: H(t) = a(£)Kq(t), where K is the 
feedback matrix - a row vector govern ing the strength of the 



feedback (e.g. IPiStefano et al. Il994h . For a first order sys- 
tem K = [ki], while for a second-order system K = [fa, fa], 
where fa and fa denote how the heating is coupled to L x 
and Lx, respectively. To maintain generality, H(t) has been 
expressed as a column vector so that it can, in principle, be 
related to any of the derivatives of L x (t) as well as Lx(t) 
itself. However, it seems likely that only the primary cou- 



q(t) = [A + a(i)BK]q(t) 



(3) 



and is said to be controllable if the matrix K exists such 
that it can yield any desired set of roots for the characteristic 
polyn omial of the closed-loop system, [Al— [A+a(t)BK]| = 
(e.g. IPiStefano et al.|[l99l ). 



3 AGN FEEDBACK MODELS WITH 
ADDITIONAL CONSTRAINTS 

The aim of optimal control theory is to determine how the 
control variable must be varied in order to minimise the 
'cost' associated with the constraint. The solutions are de- 
rived using the calculus of variations and are, therefore, op- 
timal in the same sense as a solution of the Euler-Lagrange 
equations in classical mechanics; by this definition a natu- 
ral system must reside in an 'optimal' state. As a result, 
the behaviour of a system, if interpreted correctly, provides 
valuable information about important constraints and the 
underlying physical processes at work. In the present exam- 
ple, the control variable is a(t). Given that ^ a(t) ^ 1, 
we investigate how it should be varied to minimise the total 
energy output of the system. 

As described in the introduction, the motivation for 
this choice of constraint is influenced by i) radio data (e.g. 
IBest et al.ll2005l , 120071 ; IShabala et alj|2008f ) indicating that 
AGN heating may occur in discrete outbursts; ii) mass es- 
timat es of black holes in so me Brightest Cluster Galaxies 
(e.g. iFuiita fc Reiprichll2004r i, which may be interpreted as 
having liberated insufficient accretion energy to have offset 
the ICM X-ray luminosity over the lifetime of the host clus- 
ter. Below, we outline a model that exhibits features which 
are broadly similar to standard interpretations of these ob- 
servations: AGN feedback which acts to minimise the total 
energy output from the system (i.e. gas cooling + AGN heat- 
ing) will balance gas cooling in the form of discrete heating 
events, and in a way that minimises black hole growth. 



3.1 Optimised AGN feedback 

In this section, we use optimal control theory to determine 
how a(t) should be varied in order to minimise the total en- 
ergy output of the system. The method is somewhat math- 
ematical, but the results are very general and there is no 
need to make any assumptions about the particular mode 
of accretion, only that AGN heating is optimal with respect 

to the imposed constraint. 

In opt imal control theory (see lBurghes fc Downs|[l975l : 
lKirk| [2004. for example), the control must maximise the so- 
called objective function, J, which is written as 



J = 



L[q(t),Q(t)]di, 



(4) 



where, L is the Lagrangian which quantifies the constraints 
on the system and is a function of the state and control vari- 
ables as shown. For a minimisation, the appropriate objec- 
tive function is simply the the maximising objective function 
multiplied by —1. 
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The Hamiltonian, F, of the system is generated by 
adjoining the system dynamics, f[q(t), a(t)], to the La- 
grangian, such that 



F = y(t)f[q(i),a(t)] + L[q(t) 1 a(t)l 



(5) 



where y(t) is called the costate vector, and is the dynamic 
equivalent of the Lagrange multipliers in static problems of 
maximisation. From equation ([3|, the system dynamics can 
be written f[q(t), a(t)] = q(t) - [A + a(f)BK]q((). 

Optimal control theory also makes use of Pontrya- 
gin's maximum principle, which states that the opti- 
mal state q*(i), optimal control a*(t) and corresponding 
costate vector y*(t), mu st maximise the Hamiltonian (e.g. 
iBurghes fc Downsj|l975l l. Therefore, the condition for opti- 
mality is 



dF 
da 



= 0. 



(6) 



= 



= 0. 



(T) 



For a complete solution, it is also necessary to solve the 
Euler-Lagrange equations of the Hamiltonian 

d£ _ d_ fd£ 
dq dt \ dq / 
dF _ d /<9F N 
dy dt \ dy 

Full solutions can then be obtained by applying the appro- 
priate boundary conditions, which depend on the specific 
problem. In this case, it is assumed that the end time, ti, and 
its corresponding state, Lx(ti), are unknown. This requires 
an additional boundary condition, given by yi(ii) = 0, 
where y\ is the first element of the costate vector. The initial 
X-ray luminosity is defined as Lx(to). 

The minimum energy output constraint corresponds to 
a Lagrangian of the form L[q(t),a(t)] = —[1 + a(t)K]q(t). 
Using this, the Hamiltonian must be 

F = -[l + a(i)K]q(()+y(i){q(i) - [A+a(()BK]q(()}. (8) 

Since F is linear in a(t), it will be minimised when a(t) takes 
its largest value (if d F /da > 0), or its smallest possible value 
(iidF/da < 0) (e.g. lAlexande3ll996ft . 

More specifically, for a first-order system (N — 1), di- 
mensional analysis suggests a\ ~ — r, where r is a charac- 
teristic cooling timescale, with ao ~ 1. Then, equation ((6} 
yields 



9F , T . , 



Vi(*) 



: 0. 



(9) 



Since the terminal boundary condition for the costate vari- 
able is yi(ti) — 0, equation |9| will be negative late in a 
given heating/cooling cycle. Thus, a(t) should optimally be 
zero in this limit. Earlier in the cycle, A(t) may be large 
enough to make dF/ da > 0, in which case the optimal con- 
trol is a(t) — 1 (e.g. lAlexand"erlll996l ). This is a highly sig- 
nificant result for all Hamiltonians which are linear in the 
control variable: the optimal control always lies on a bound- 
ary of the control set, but can switch from one boundary 
point to the other - the so-called 'bang-bang' solution. 

Equation ((6J will be satisfied when yi(t t ) = r, where t* 
denotes the time after the start of each cycle at which a(t) 
switches from 1 — ► 0. The value of t* is usually obtained by 
solving equation 0, which itself yields a differential equa- 
tion for the time-dependence of y\. However, since the initial 



value of y\(to) is unknown, we must estimate t» by minimis- 
ing the total energy output with respect to t», using 



_d_ 

dt* 



[L x (t) + H(t)]dt = 0. 



(10) 



For this calculation, we require the complete solution for the 
time-evolution of the X-ray luminosity of the g clS , ("IS outlined 
below. 

Since, a(t) is initially 1 and subsequently switches to 0, 
there will be two distinct regimes per cycle; the AGN will 
be active during the interval [to, to +£*], but inactive during 
the subsequent interval, [to Then, according to the 

boundary conditions, the solution must be 



L x (t) = < 



Lx(io) exp 



[l-ki 



(t-to) 



L x (*o) ex P 



(t.+tp) 



if t < t < t + U 



\t—(tn+t f )] 

exp ! 

If * + ** < t < ti 



Similarly, the AGN heating rate is 

fciL x (t), ifi <t<t +t» 
0, if to +U < t < ti. 



H(t) 



Then, substituting for Lx(t) and H(t) in equation (|10|) . we 
find the optimal switching time to be t* — (ti — to) — Tin 2. 

Without making further assumptions, it is not possi- 
ble to calculate the precise value of t*. However, in gen- 
eral terms, since AGN heating probably does not reduce 
the X-ray luminosity by a large factor during each cycle, 
the switching time should scale as t* ~ r/(ki — 1). Indeed, 
assuming that the AGN is re-triggered when the ambient 
conditions return to a state that is similar to the initial con- 
figuration (i.e. L(ti) w L(to)), a heating/cooling cycle will 
have a duration ti — to ~ rfei ln(2)/(fci — 1), and switching 
time, t* « rln(2)/(fci — 1). Therefore, for optimal, periodic 
heating the duty cycle will be S = £*/(ti — to) = 1/fci. 

Figure 1 shows the time-evolution of the AGN heating 
rate and X-ray luminosity for this first-order heating/cooling 
system under the assumptions of periodic, optimal feedback. 
In the figure, the feedback strength is ki = 10, so that the 
duty cycle of AGN heating is 8 « 0.1. 

Under the assumption of periodic heating, the energy 
injected by the AGN each cycle is the same as the en- 
ergy radiated by the gas. For optimal heating, this quan- 
tity is _E hcat = E cool = Lx(to)rki/[2(ki - 1)]. Thus, 
the total energy produced each cycle, is E out = iJhcat + 
i^cooi = Lx(to)rki/(ki — l). In addition, given that the time- 
averaged AGN power output is rate is (H) = E^ eat /{t\ — to), 
the time-averaged black hole growth rate must be (Mbh) = 
(H}/(nc 2 ) — Lx(io)/(f?c 2 In 4), where rj is the standard ac- 
cretion efficiency and c is the speed of light. During the 
accretion phase, the average accretion rate of the black hole 
growth rate is a factor ki — 1/8 greater, and can be approxi- 
mated by Mbh = Lx(to) / (Sr/c 2 In 4). Consequently, systems 
with characteristically small duty cycles will experience brief 
phases of rapid black hole growth. In contrast, black hole 
growth in systems with duty cycles closer to unity will be 
much more uniform. 
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Figure 1. Two heating/cooling cycles of the X-ray luminosity, Lx(t), and AGN heating rate, H(t), for a first-order, linear feedback 
system, subject to the minimum energy constraint. The values on the y-axis are given by Lx(t)/Lx{to) and H(t)/Lx{to), while the 
x-axis is in units of the characteristic timescale of the system, r. In this example, the feedback strength is fci = 10, so that duty cycle is 
8 ks 0.1. 



4 DISCUSSION 

Observationally, the radio AGN duty cycle is found to in- 
crease steeply w ith the stellar mass of the host galaxy (e.g. 
iBest et al.ll2005l), a nd is higher still for Brightest Cluster 
Galaxies ( Best et alj|2007h . In the context of the model pre- 
sented here, this suggests that the feedback strength de- 
creases with increasing stellar mass. 

If the argument above holds, the ratio of the instan- 
taneous heating and cooling rates (H/Lx = fa) will also 
decrease with increasing stellar mass of the host galaxy. 
Consequently, lower mass systems must experience propor- 
tionally more powerful heating events. As a result, the mo- 
mentum and energy supplied by the AGN would be much 
more capable of expelling X-ray emitting material from the 
gravitational potential of an elliptical galaxy than a galaxy 
cluster. This scenario would appear to be consistent with 
recent theoretical interpretations of the steepening of the 
L x - T relation below 1-2 ke V (e.g. iPuchwein et all liooi 
iBower et al]|200St |Popell2009l ). 

A plausible relationship between fa and the average 
temperature of the ambient gas, is as follows. When ac- 
tivated, the AGN heating rate is assumed to be propor- 
tional to the X-ray luminosity, such that H(t) = t/Mbhc 2 = 
faLx(i), where Mbh is the black hole fuelling rate, and 
the other quantities are as previously defined. The classi- 
cal mass flow rate for an X-ray emitting atmosphere with 
luminosity Lx(t), and average temperature T, is defined as 
Lx = (5 /2)faT M c \ aB I (jirip , where fa is the Boltzmann con- 
stant and firrip is the mean mass per particle. Thus, if a 
fraction, (f>, of the classical mass flow rate reaches the super- 
massive black hole, we can write Mbh = (f>M c ia.s, and it can 
be shown that fa = 24>r/fim p c 2 /(5faT). Therefore, stronger 
feedback (and smaller duty cycles) should be observed in 
cooler, less massive systems, as is consiste nt with standard 
interpretations of radio A GN observations (|Best et al.ll2005l . 
l2007l : IShabala et alJlioolh . 



To calculate a numerical value for fa, we assume a 
canonical accretion efficiency of r\ — 0.1, which yields 
fa = 1/5 w 26O(0/q . Ol)(T '/lO 7 K)" 1 . For low mass elliptical 
galaxies. IBest et all (|2005h found S ~ 1CT 4 - 1CT 3 which, in 
the context of the present model suggests fa ~ 10 3 — 10 4 . 
Thus, for a characteristic X-ray temperature of T ~ 10 6 K, 
a value of fa ~ 10 3 - 10 4 can only be obtained if <j> ~ 10 
In contrast, the duty cycle of radio AGN activity in Bright - 
est Cluster Galaxies is 8 ~ 0.1 - 1 (e.g. IBest et al.1 120071 ), 
suggesting that fa ~ 1 — 10. Given that the typical X-ray 
temperature in such systems is T ~ 10 s K, the fraction of the 
classical cooling flow rate accreted by the black hole must 
be <f> ~ 10" 4 - 10" 3 . 

If the reasoning outlined above approximates reality, we 
might infer that the accreted fraction, <f>, tends to decrease 
in hotter (more spatially extended) systems. The simplest 
qualitative explanation for such a phenomenon is that the 
black hole predominantly accretes material from the central 
region of a galaxy or cluster. Therefore, the fraction of ma- 
terial accreted from the entire cooling flow will be governed 
by the size of this central region relative to the size of the 
region within which the classical cooling flow rate applies. 



5 SUMMARY 

The aim of this article has been to demonstrate how stan- 
dard techniques optimal control theory can be used to inves- 
tigate some of the fundamental characteristics of feedback 
which may be applicable to AGN heating in massive galaxies 
and galaxy clusters. Although it has not yet been possible 
to construct a completely satisfactory model for AGN heat- 
ing, the application of optimal control theory has elucidated 
some potentially important features of constrained feedback 
systems. The main findings are described below. 

(i) Optimal control theory provides a way to impose addi- 
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tional constraints on the system, with the minimum number 
of assumptions. In general terms, constraints are extremely 
useful for conceptualising the interaction between the AGN 
and its environment and interpreting observational signa- 
tures. More specifically, we have shown that AGN heating 
(regulated by feedback) which acts to minimise the total 
energy output of the system, occurs in the form of discrete, 
periodic events. This constraint ensures that AGN heating 
balances gas cooling with the minimum black hole growth 
and produces behaviour which is broadly compatible with a 
range of observations. However, this is only one interpreta- 
tion and explanation of the observations. In principle, there 
may be other effects or constraints which achieve similar 
outcomes. 

(ii) The duty cycle for periodic AGN activity in a first- 
order, linear feedback system is 8 ~ l/fci, where ki is the 
feedback strength. If this interpretation is applied to ob- 
servations which show radio AGN duty cycles increasing 
with the stellar mass of the host galaxy l|Best et al.ll2005l . 
l2007l ; IShabala et aljEfflOsh , we would infer that the feedback 
strength decreases as the system stellar mass increases. In 
turn, this would mean that AGN outbursts in lower mass 
systems are proportionally stronger than those in more mas- 
sive environments so that AGN heating events may be suffi- 
ciently powerful to expel hot gas from the gravitational po- 
tential of a galaxy, but not a galaxy cluster. A description 
of this sort is in qualitative agreement with recent theoret- 
ical explanations for the steepening of the Lx — T relation 
for temperatures below 1-2 k eV (e.g. iPuchwein et alj|200st 
iBower et al.1l2008l ; |Popell2009h . 
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